Systems for per persona processing media content-associated metadata

ABSTRACT

Various systems and methods described above permit a user&#39;s content experience (e.g. music playing experience) to be monitored and for metadata describing this experience to be collected. This metadata can be dynamically updated as a user experiences media content and then used to impart to the user a personalized experience that is tailored to that specific user. A user&#39;s metadata can, in some instances, provided across a wide variety of computing devices on which the user may experience the media content, thus standardizing the user&#39;s personalized media experience. In addition, intelligent or “smart” playlists can be provided which, in some instances, can be dynamically and automatically updated to reflect current user experiences, thus providing a highly personalized and enjoyable content experience.

RELATED APPLICATION

This application is a continuation of and claims priority to U.S. patentapplication Ser. No. 10/959,014, filed on Oct. 5, 2004 which, in turn,is a continuation of and claims priority to U.S. patent application Ser.No. 10/100,513, filed on Mar. 21, 2002 now U.S. Pat. No. 7,220,920, thedisclosures of which are incorporated by reference.

TECHNICAL FIELD

This invention relates generally to media processing methods andsystems.

BACKGROUND

Many computing devices such as personal computers, desk top computersand various handheld computing devices include software that enablesvarious types of media to be played or rendered on the device.Media-playing software can typically play or render digital media in theform of audio and video data. As an example, today people can insert afavorite CD into the CD receptacle of their personal computer and listento their musical selection while they work on the computer. Further,technological advances in media playing applications have enabled peopleto not only store media content files (such as music and video files) ontheir computer for subsequent rendering, but have media content streamedto their computing device for rendering in real time.

One of the tools that has evolved in connection with variousmedia-playing applications is the playlist. A playlist is a customizedlist of files that a user can define and which will be played orrendered by a media-playing application. A playlist can enable the userto group various media content together to be played in any orderspecified by the user. For example, a user can define a playlist thatincludes tracks from particular CDs, a radio station, and a video. Theplaylist groups the media content and stores the location of the mediacontent so that the media content can be accessed at the appropriatetime by the media-playing application and rendered for the user. Thus,playlists can enable a user to custom design their own media experience.

However, while playlists have, in general, provided the user with theopportunity to craft a custom-designed media experience, contemporaryplaylists suffer from a serious drawback that does not make the userexperience all that it could be. Specifically, playlists are typicallystatic in nature and are generally unintelligent. That is, the contentthat typically comprises the playlist (i.e. the list of files and/orcontent locations associated with content that is to be played) isgenerally fixed at the time it is authored and remains that way untilthe user physically edits the playlist. Thus, playlists at best tend tobe flat lists of items that do not change until physically re-authoredby a user.

Aside from the issue of playlists and their perceived inadequacies, amore fundamental problem exists and pertains to the inability of theuser to have a user-specific media experience provided for them.Specifically, most often the user experiences media content passively.They may turn on a radio station or play a particular CD and are forcedto passively listen to the content unless they proactively take somestep to change the content to which they are listening. Yet, many usershave strong opinions as to what they wish to listen to.

Accordingly, this invention arose out of concerns associated withproviding improved media processing methods and systems-particularlymethods and systems that can flexibly accommodate users on an individualbasis. In addition, this invention arose out of concerns associated withproviding improved playlists for use by media processing methods andsystems.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an exemplary computer system that can beutilized to implement one or more embodiments.

FIG. 2 is a block diagram illustrating a media-playing application and acontent database in accordance with one embodiment.

FIG. 3 is a flow diagram illustrating steps in a method in accordancewith one embodiment.

FIG. 4 is a block diagram illustrating different types of computingdevices.

FIG. 5 is a flow diagram illustrating steps in a method in accordancewith one embodiment.

FIG. 6 is a block diagram illustrating an illustrative computing systemin accordance with one embodiment.

FIG. 7 is a flow diagram illustrating steps in a method in accordancewith one embodiment.

FIG. 8 is a block diagram that illustrates aspects of one embodiment.

FIG. 9 is a flow diagram illustrating steps in a method in accordancewith one embodiment.

FIG. 10 is a block diagram that illustrates an exemplary system inaccordance with one embodiment.

FIG. 11 is a diagrammatic representation of an exemplary user interfacein accordance with one embodiment.

FIG. 12 is a block diagram that illustrates architectural aspects of oneembodiment.

FIG. 13 is a flow diagram illustrating steps in a method in accordancewith one embodiment.

FIG. 14 illustrates an exemplary file format in accordance with oneembodiment.

FIG. 15 is a flow diagram illustrating steps in a method in accordancewith one embodiment.

FIG. 16 is a flow diagram illustrating steps in a method in accordancewith one embodiment.

DETAILED DESCRIPTION

Overview

Various systems and methods described below permit a user's contentexperience (e.g. interaction experience or music playing experience) tobe monitored and for metadata describing this experience to becollected. As used in this document, the term “metadata” will beunderstood to include one or more metadata items. The metadata isdeveloped by monitoring a number of different parameters that areassociated with the user's content experience. This metadata can bedynamically updated as a user experiences or interacts with mediacontent and then used to impart to the user a personalized experiencethat is tailored to that specific user. In some embodiments, themetadata can be actually associated with the specific media content thata user can experience by playing the media content. Additionally, theuser can experience media content in other ways such as managing themedia content, moving or copying the media content from one location toanother, or a variety of other ways outside of simply listening to orplaying the media content. All of these various operations imply, insome way, that the user has a certain care for or interest in the mediacontent. The fact that the user went to media content and operated on itsomehow implies that there is an implicit interest in that media contentthat is greater than simply playback.

In some embodiments, a user's metadata and, in some instances theassociated media content, can be provided across a wide variety ofcomputing devices on which the user may experience the media content,thus standardizing the user's personalized media experience. As metadatafor the user is modified, it can be reconciled across one or moredevices so that the user's metadata is generally up-to-date.

In some embodiments, multiple users can share one or more computingdevices. In these embodiments, each of the user's metadata can becollected and used to provide each user an experience that is unique forthem. This metadata can, as described above, be provided across andreconciled on multiple different computing devices that the users mightuse to experience media content.

In addition, inventive new file structures and formats are provided thatconveniently enable one or more user's metadata to be collected and, insome instances, bundled with its associated content. Privacy concernsare addressed, in some embodiments, by uniquely identifying individualusers in a manner that they and perhaps others within their group canrecognize, but which others outside the group are not able to recognizeand/or backward decode to ascertain the user's actual identity.

Using the above-referenced systems and methods, intelligent or “smart”playlists can be provided which, in some embodiments, can be dynamicallyand automatically updated to reflect current user experiences. The smartplaylists can make use of the rich and robust collection of usermetadata to tailor playlists for individual users that accuratelyreflect the user's desired experiences, thus providing a highlypersonalized and enjoyable content experience.

In one implementation, a novel file structure or format is provided todefine individual playlist files that can be processed by a playlistengine. The playlist engine can, in some embodiments, process theplaylist file to access one or more filters that can be used to executequeries against one or more databases that contain the user metadata.The queries can also be contained in the playlist file. In addition,support is provided in the file structure for computing devices that arenot capable of executing database queries, but which can be used by theuser to access and play content contained in a playlist. This supportcomes in the form of a static portion of the file format that contains acontent list that essentially lists the various content that is thesubject of the playlist. This static portion can be developed andprovided into the file whenever a playlist engine executes a databasequery on a computing device that supports such queries.

In addition, in some embodiments, the playlists that are generated areable to intelligently repair themselves. That is, within the filestructure various paths to media content can be defined. If mediacontent is, for some reason moved such that it does not coincide withits path, the file structure includes data that can be used to find themedia content and to intelligently repair or replace the old path with anew, accurate path.

In some embodiments, intelligent processing can be done locally, withinthe realm of the user's computing environment. That is, allpersonalization can be done within the user's purview and need not bemade available to others. Thus, the user can have intelligentpersonalization without any of their information being divulged toanother party.

Exemplary Computer Environment

FIG. 1 illustrates an example of a suitable computing environment 100 onwhich the system and related methods described below can be implemented.

It is to be appreciated that computing environment 100 is only oneexample of a suitable computing environment and is not intended tosuggest any limitation as to the scope of use or functionality of themedia processing system. Neither should the computing environment 100 beinterpreted as having any dependency or requirement relating to any oneor combination of components illustrated in the exemplary computingenvironment 200.

The inventive techniques can be operational with numerous other generalpurpose or special purpose computing system environments,configurations, or devices. Examples of well known computing systems,environments, devices and/or configurations that may be suitable for usewith the described techniques include, but are not limited to, personalcomputers, server computers, thin clients, thick clients, hand-held orlaptop devices, multiprocessor systems, microprocessor-based systems,set top boxes, programmable consumer electronics, network PCs,minicomputers, mainframe computers, distributed computing environments,hand-held computing devices such as PDAs, cell phones and the like.

In certain implementations, the system and related methods may well bedescribed in the general context of computer-executable instructions,such as program modules, being executed by a computer. Generally,program modules include routines, programs, objects, components, datastructures, etc. that perform particular tasks or implement particularabstract data types. The inventive techniques may also be practiced indistributed computing environments where tasks are performed by remoteprocessing devices that are linked through a communications network. Ina distributed computing environment, program modules may be located inboth local and remote computer storage media including memory storagedevices.

In accordance with the illustrated example embodiment of FIG. 1,computing system 100 is shown comprising one or more processors orprocessing units 102, a system memory 104, and a bus 106 that couplesvarious system components including the system memory 104 to theprocessor 102.

Bus 106 is intended to represent one or more of any of several types ofbus structures, including a memory bus or memory controller, aperipheral bus, an accelerated graphics port, and a processor or localbus using any of a variety of bus architectures. By way of example, andnot limitation, such architectures include Industry StandardArchitecture (ISA) bus, Micro Channel Architecture (MCA) bus, EnhancedISA (EISA) bus, Video Electronics Standards Association (VESA) localbus, and Peripheral Component Interconnects (PCI) bus also known asMezzanine bus.

Computer 100 typically includes a variety of computer readable media.Such media may be any available media that is locally and/or remotelyaccessible by computer 100, and it includes both volatile andnon-volatile media, removable and non-removable media.

In FIG. 1, the system memory 104 includes computer readable media in theform of volatile, such as random access memory (RAM) 110, and/ornon-volatile memory, such as read only memory (ROM) 108. A basicinput/output system (BIOS) 112, containing the basic routines that helpto transfer information between elements within computer 100, such asduring start-up, is stored in ROM 108. RAM 110 typically contains dataand/or program modules that are immediately accessible to and/orpresently be operated on by processing unit(s) 102.

Computer 100 may further include other removable/non-removable,volatile/non-volatile computer storage media. By way of example only,FIG. 1 illustrates a hard disk drive 128 for reading from and writing toa non-removable, non-volatile magnetic media (not shown and typicallycalled a “hard drive”), a magnetic disk drive 130 for reading from andwriting to a removable, non-volatile magnetic disk 132 (e.g., a “floppydisk”), and an optical disk drive 134 for reading from or writing to aremovable, non-volatile optical disk 136 such as a CD-ROM, DVD-ROM orother optical media. The hard disk drive 128, magnetic disk drive 130,and optical disk drive 134 are each connected to bus 106 by one or moreinterfaces 126.

The drives and their associated computer-readable media providenonvolatile storage of computer readable instructions, data structures,program modules, and other data for computer 100. Although the exemplaryenvironment described herein employs a hard disk 128, a removablemagnetic disk 132 and a removable optical disk 136, it should beappreciated by those skilled in the art that other types of computerreadable media which can store data that is accessible by a computer,such as magnetic cassettes, flash memory cards, digital video disks,random access memories (RAMs), read only memories (ROM), and the like,may also be used in the exemplary operating environment.

A number of program modules may be stored on the hard disk 128, magneticdisk 132, optical disk 136, ROM 108, or RAM 110, including, by way ofexample, and not limitation, an operating system 114, one or moreapplication programs 116 (e.g., a multimedia application program), otherprogram modules 118, and program data 120. A user may enter commands andinformation into computer 100 through input devices such as keyboard 138and pointing device 140 (such as a “mouse”). Other input devices mayinclude a audio/video input device(s) 153, a microphone, joystick, gamepad, satellite dish, serial port, scanner, or the like (not shown).These and other input devices are connected to the processing unit(s)102 through input interface(s) 142 that is coupled to bus 106, but maybe connected by other interface and bus structures, such as a parallelport, game port, or a universal serial bus (USB).

A monitor 156 or other type of display device is also connected to bus106 via an interface, such as a video adapter 144. In addition to themonitor, personal computers typically include other peripheral outputdevices (not shown), such as speakers and printers, which may beconnected through output peripheral interface 146.

Computer 100 may operate in a networked environment using logicalconnections to one or more remote computers, such as a remote computer150. Remote computer 150 may include many or all of the elements andfeatures described herein relative to computer.

As shown in FIG. 1, computing system 100 is communicatively coupled toremote devices (e.g., remote computer 150) through a local area network(LAN) 151 and a general wide area network (WAN) 152. Such networkingenvironments are commonplace in offices, enterprise-wide computernetworks, intranets, and the Internet.

When used in a LAN networking environment, the computer 100 is connectedto LAN 151 through a suitable network interface or adapter 148. Whenused in a WAN networking environment, the computer 100 typicallyincludes a modem 154 or other means for establishing communications overthe WAN 152. The modem 154, which may be internal or external, may beconnected to the system bus 106 via the user input interface 142, orother appropriate mechanism.

In a networked environment, program modules depicted relative to thepersonal computer 100, or portions thereof, may be stored in a remotememory storage device. By way of example, and not limitation, FIG. 1illustrates remote application programs 116 as residing on a memorydevice of remote computer 150. It will be appreciated that the networkconnections shown and described are exemplary and other means ofestablishing a communications link between the computers may be used.

Monitoring a User's Content Experience

In the embodiments described below, a user's so-called contentexperience is monitored and data describing this experience ismaintained. This maintained data can then form the basis for a robustcollection of future user-specific content experiences. In the examplethat follows, the content that is utilized for illustrative purposes ismusic content, such as that a user would listen to on a computing devicevia an appropriate media-playing application. It is to be appreciatedthat the various inventive principles can be utilized in connection withcontent other than, or not solely music content, e.g. video content,audio/video content, images/photos and the like. In addition, it is tobe appreciated and understood that the user can experience the mediacontent in ways other than simply playing the media content. Examples ofthis are noted above.

FIG. 2 shows but one exemplary system that can be utilized to monitor auser's content experience and maintain data that is associated with thatexperience. Here, a media-playing application 200 is provided and cancomprise part of a user's computing device (e.g. personal computer,handheld and the like). An experience-monitoring module 202 is providedand, in this example, comprises part of the media-playing application.Such need not, however, be the case. For example, theexperience-monitoring module can comprise a separate component or partof another component. In addition, the experience-monitoring module canbe located locally on the user's computing device, or remotely onanother computing device such as a server.

A content database 204 is provided and contains content that isrenderable or playable by the media-playing application 200. The term“database” as used in this document is intended to mean not onlytraditional database structures, but more generally, collections ofitems, materials or content such as files and the like. The contentdatabase can be located locally on the user's computing device.Additionally or alternately, the content database or portions thereofcan be located remotely. The content database can contain a contentcollection 206 comprising one or more pieces of content 208 that can beplayed or rendered by the media-playing application 200. Each piece ofcontent 208 includes a content portion (designated as “content”), andcan include a user metadata portion (designated “user metadata”).

In the illustrated example, the content collection 206 comprises acollection of music content. Additionally, each piece of content 208, inthis example, comprises an individual song or track that can be playedby the media-playing application. It is to be appreciated that the levelof granularity at which the content pieces are provided can be otherthan at the song or track level. Such content portions are typicallyprovided as individual files or entries. Thus, in this example, the userhas many different songs or tracks that are available for rendering bythe media-playing application.

As a user selects various pieces of content 208 to be rendered by themedia-playing application, the experience-monitoring module 202 can makea note of this and can produce user metadata that is provided back intothe user metadata portion of the piece of content. Thus, relevantcurrent data that is associated with the user's content experience canbe developed and associated with the particular content for future use.This developed metadata can be tightly bound to the content so that theuser's experience or, in this example the user's “listening habits” canbe learned and subsequently used, as will become more apparent below.

FIG. 3 is a flow diagram of steps in a method in accordance with oneembodiment. The method can be implemented in any suitable hardware,software, firmware, or combination thereof. In but one embodiment, themethod can be implemented in software.

Step 300 provides media content that can be rendered by a media-playingapplication. Any suitable content can be provided such as digital audio,digital video, digital audio/video, and/or photos/images and the like.In one embodiment, such as one that is discussed above, the mediacontent is provided as music content. Typically, although notexclusively, such content is provided as a file or files that arelocated on a local computing device such as a user's personal computeror handheld device. Such content can, however, be provided on aremotely-accessible device such as another computer or server linked viaa network. Step 302 monitors a user's media-playing experience. Thisstep can be implemented by noting, among other things, what content isexperienced by the user and when it is experienced. In the music contentembodiment, this step is implemented by monitoring the user's listeninghabits. Non-exclusive, specific examples of parameters that can bemonitored are given below in the section entitled “Exemplary Schema ofUser Behaviors”.

Step 304 produces metadata associated with the user's media-playingexperience. This step can be implemented by producing metadata that isassociated with the various parameters that can be monitored. Again,examples of this are provided below. Step 306 associates producedmetadata with media content experienced by the user. This step can beimplemented in any suitable way. For example, the metadata can comprisepart of a piece of content that includes the content itself, an exampleof which is given above.

By developing metadata and associating, in some way, the metadata withthe content that a user experiences, the user can be provided a rich androbust media experience. This will become more clear below.

Exemplary Schema of User Behaviors

As a user's content experience is monitored, a number of differentparameters can be monitored and associated as metadata with the contentthe user experiences. The examples given below are intended as examplesonly and should not, accordingly, be construed to limit the parametersor types of parameters that can be utilized. Hence, other parameters canbe used without departing from the spirit and scope of the claimedsubject matter.

Exemplary parameters that can be monitored, each of which are explainedbelow include, without limitation:

-   -   USER_UPDATE_TIME    -   USER_LAST_PLAYED_TIME    -   USER_RATING    -   USER_EFFECTIVE_RATING    -   USER_SERVICE_RATING    -   USER_PLAYCOUNT_TOTAL    -   USER_PLAYCOUNT_MORNING    -   USER_PLAYCOUNT_AFTERNOON    -   USER_PLAYCOUNT_EVENING    -   USER_PLAYCOUNT_NIGHT    -   USER_PLAYCOUNT_WEEKDAY    -   USER_PLAYCOUNT_WEEKEND    -   USER_PLAYCOUNT_EVERYDAY    -   USER_CUSTOM_N    -   USER_EFFECTIVE_RATING_COMPUTED

USER_UPDATE_TIME

The user update time is the time that any of the other schema items orparameters are updated. That is, some of the parameters can bephysically updated by the user (e.g. user rating) and other parameterscan be updated automatically by the system. This parameter keeps trackof when the parameters were updated. This can be a useful piece ofinformation in the event that the user utilizes multiple differentcomputing devices to experience common media. For example, the user mayhave a home computer and an office computer on which they listen totheir CD collection. In this event, the user update time can be utilizedfor a reconciliation process to reconcile the user's listen habitsbetween devices. That is, assume that there is a media file (such ascontent piece 208 in FIG. 2) that contains content (i.e. music) and theuser's developed metadata. On a first device (perhaps their homecomputer) the user changes a user rating (see below) on a song from 4 to5. On their office device, the song still carries the older rating of 4.During a reconciliation process, the user's metadata from their homedevice can be reconciled with the metadata on their office device. Inthis case, the user update time will indicate that the last time therewas a rating change, the song in question had a rating change from a 4to 5. Thus, the metadata on the user's office device can be updated toreflect the most current user metadata.

USER_LAST_PLAYED_TIME

The last played time parameter comprises the date or time that aparticular piece of content was played or experienced by the user. Thisparameter can be used to implement intelligent playlists which aredescribed in more detail below in the section entitled “IntelligentPlaylists”.

USER_RATING

The user rating parameter can be used to allow the user to rate theircontent. For example, the user can assign values to content based onwhether they like or dislike the content and the degree to which theylike or dislike the content. In the illustrated and describedembodiment, the user can use a “star rating” system where one star isassociated with content the user dislikes and five stars is associatedwith content that the user likes the most, with varying valuestherebetween.

USER_EFFECTIVE_RATING

The effective rating parameter is a tool that can be used by the systemto provide an “effective rating” for content that the user has notphysically rated. That is, the system can automatically monitor the userand their content choices. Based on the user's content choices andfrequency of play, the system can assign an effective rating. Effectiveratings can be assigned at various levels of granularity as well. Forexample, effective ratings can be assigned for defined time periods,e.g. “Songs I like on Sunday night”, “Songs I like on Monday mornings”and the like.

In addition, the effective ratings can be visually distinguished, in theuser interface, from the user ratings. For example, the user's ratingscan be displayed as bright yellow stars and the effective ratings can bedisplayed as dim yellow stars. One example of this appears in, and isdiscussed in relation to the user interface of FIG. 11.

USER_SERVICE_RATING

The user service rating parameter can be used to provide a rating from athird party. For example, a web service such as MSN music can provide arating for the content. This parameter can be useful for computingeffective ratings.

USER_PLAYCOUNT_TOTAL

The playcount total comprises the total number of times a particularpiece of content has been played by the user. This parameter can beuseful for computing effective ratings.

USER_PLAYCOUNT_MORNING, AFTERNOON, EVENING, NIGHT, WEEKDAY, WEEKEND,EVERYDAY

These various parameters enable the system to keep track of when contentis played throughout the day. For example, the playcount morningparameter can be used to keep a playcount of the content that is playedfrom 6 A.M. to noon, the playcount afternoon can be used to keep aplaycount of the content that is played between noon and 5 P.M. and soon.

These parameters can be useful for determining the user'scontent-experiencing habits relative to different times of day orthrough the week. This information can be used, in the case ofintelligent playlists (described below), to provide the user with arich, user-specific content-experience. For example, the user can definean intelligent playlist that comprises “Songs I like in the evening.”Thus, when the playlist is opened by the user, the user will havedisplayed, via the user interface, all of the songs that they havelistened to in the evening. The same can be said for a playlistcomprising “Songs I like on Weekends”, “Songs I like Everyday”, or“Songs I like on Sunday night”. As the user plays music on Sunday night,this playlist can change dynamically, as will be more apparent below.

USER_CUSTOM_{N}

The user custom parameter can be provided to enable the user to programtheir own individual schema items. The “N” designation indicates thatany number of user-defined parameters can be defined. In addition, theparameters can be defined per media or per user. In addition, thesecustom parameters can also be used by third parties (such as a webservice) to put their own rating or perhaps an expiration date into thesystem. Thus, the custom parameters enable an extensibility feature tobe added.

USER_EFFECTIVE_RATING_COMPUTED

The effective rating computed parameter comprises a timestamp for whenthe effective rating was computed. This can be provided on a per userbasis. This parameter can be useful for purposes of maintaining acurrent or reasonably current effective rating.

Thus, the above schema can advantageously permit implementation of agreat number of personalization features—i.e. those features that arepersonalized to the user. Advantageously, the user's content experiencecan be monitored and analyzed at different levels of granularity which,in turn, allows the system to understand a user's behavior at a morefundamental and personal level.

Moving a User's Content Experience Between Devices

In one embodiment, a user's content experience can be maintained acrossmultiple different devices. As an example, consider FIG. 4.

There, a system 400 comprises multiple different “experience points” atwhich a user may opt to experience particular content. For example, oneexperience point comprises a home computer 402. Other experience pointscan comprise a work computer 404, a personal digital assistant 406, acell phone 408 and a CD or DVD player 410. For purposes of thisdocument, these devices can also be considered as computing devices.

Each of these devices can contain a database that includes the user'smetadata. As an example, each device can have a database such asdatabase 204 (FIG. 2) that includes the user's metadata. In addition,each device can, but need not, have the content that is associated withthe user's metadata.

Accordingly, when a user experiences content, e.g. listens to music, ontheir home computer 402, the media-playing application or some othermodule can monitor and produce metadata as described in FIG. 3. Inaddition, this metadata can be added to the user's database to updatethe user's content experience. Periodically, whether through anautomatic process or a user-initiated process, the databases on theother devices can be updated. Alternately or additionally, in someembodiments, whenever the user's metadata changes, such changes can bebundled up and pushed to the other devices. For example, the user's homecomputer 402 and work computer 404 can reconcile the user's metadata viaa network connection such as the Internet. This can be a direct or anindirect reconciliation. Specifically, in some embodiments, the homecomputer can automatically establish a link with the work computer anddirectly push the changes to the work computer. Alternately, a thirdparty, such as a web service, can include a central database thatmaintains a user's metadata and can periodically reconcile the user'smetadata across devices.

In addition to sharing metadata across devices, in some embodiments, thecontent (including the metadata) can be shared across the user'sdevices. For example, assume that the user has several pieces of contentwith accompanying metadata. Assume also that the user builds playlist ontheir home computer and transmits the playlist, along with the content,to their handheld device. This can be accomplished via a simple filetransfer process. Now, not only does the user's handheld device have thecontent that the user wishes to experience, it also includes the user'sassociated metadata. Now, as the user interacts with their playlist andexperiences the content on their handheld device, the user's metadatacan be modified and subsequently reconciled with the metadata on theuser's other devices.

Reconciliation can take place via suitable two-way replication of datawhenever a file is moved. This can ensure that data loss is minimized.Bi-directional replication is a well known concept and, for the sake ofbrevity, it is not further discussed.

FIG. 5 is a flow diagram of steps in a method in accordance with oneembodiment. The method can be implemented in any suitable hardware,software, firmware, or combination thereof. In but one embodiment, themethod can be implemented in software.

Step 500 provides media content that can be rendered by a media-playingapplication. Any suitable content can be provided such as digital audio,digital video and/or digital audio/video and the like. In oneembodiment, such as one that is discussed above, the media content isprovided as music content. Typically, although not exclusively, suchcontent is provided as a file or files that are located on a localcomputing device such as a user's personal computer or handheld device.Such content can, however, be provided on a remotely-accessible devicesuch as another computer or server linked via a network.

Step 502 monitors a user's media-playing experience. This step can beimplemented by noting, among other things, what content is experiencedby the user and when it is experienced. In the music content embodiment,this step is implemented by monitoring the user's listening habits.Non-exclusive, specific examples of parameters that can be monitored aregiven above in the section entitled “Exemplary Schema of UserBehaviors”.

Step 504 produces metadata associated with the user's media-playingexperience. This step can be implemented by producing metadata that isassociated with the various parameters that can be monitored. Again,examples of this are provided above. Step 506 associates producedmetadata with media content experienced by the user. This step can beimplemented in any suitable way. For example, the metadata can comprisepart of a piece of content that includes the content itself, an exampleof which is given above. Additionally or alternately, the metadata canbe associated with an identifier that is itself associated with thecontent.

Step 508 reconciles the user's metadata with one or more devices onwhich the user experiences content. This step can be accomplishedresponsive to a user transferring media content files between devices.That is, when the files (including the associated metadata) are pushedacross a network to another of the user's devices, the reconciliationprocess can search through the metadata and reconcile it on the otherdevices.

Alternately or additionally, this step can be accomplished responsive toa user experiencing content on different devices. For example, assumethat the user has the new U2 CD and listens to it at home. The user thentakes the CD to work and listens to it at their work computer. In thisexample, the user's work system will make note that the user haslistened to the CD and can, for example, update the user's metadataassociated with the last played time parameter. Assume also that duringa lunch break, the user rates several of the tracks on the CD using thestar-rating system described above. The user's work system can then, viathe reconciliation process mentioned above, see to it that the user'smetadata is reconciled on his home computer. In this example, only theuser's metadata (and not the media content itself) is pushed across thenetwork.

By developing metadata and associating, in some way, the metadata withthe content that a user experiences, the user can be provided a rich androbust media experience. Further, by reconciling the user's metadataacross different user devices, the user can be assured of a contentexperience that is generally standardized across the various devicesthat might be used to experience content.

Multiple Users Sharing One or More Devices

One of the advantages of being able to produce and track metadata on aper user basis, as well as reconcile user metadata across multipledevices, is that the system can support multiple users. That is,multiple users who share one or more devices can have their metadatamonitored and modified across multiple devices so that their contentexperience is generally standardized across the multiple devices thatthey might use to experience content. As an example, consider FIG. 6.

There, a system 600 includes multiple different devices one or more ofwhich can be shared by multiple different users. For example, the systemincludes a home computer 602 a that can be used by four differentusers-Lance, Melissa, Grace and Max. A kid's computer 602 b ispresumably used by the kids. In addition, there are three additionalcomputers—604 a (Lance's work computer), 604 b (Melissa's work computer)and 604 c (Grace's dorm computer). Additional devices include two PDAs606 a, 606 b, three cell phones 608 a, 608 b, and 608 c, as well as aCD/DVD player 610.

Assume in this example, that the users share a content collection thatincludes music—both in the form of CDs and digital music files. As isusually the case, assume also that the users have different listeninghabits, likes and dislikes. So, for example, while Lance may prefer tolisten to Jimmy Buffet, The Doobie Brothers, and Dave Matthews Band,Grace may prefer Britney Spears, and various Disney soundtracks such asThe Little Mermaid, The Lion King and Tarzan. Accordingly, in thisembodiment, each of the user's individual media-playing experience ismonitored and metadata is produced for and associated with each of theusers and the associated content. Thus, each user can have a per-userexperience based on their actually observed content-experiencing habits.

In addition, each of the individual devices with which particular usersinteract can have user metadata provided to it for reconciliation asdescribed above. Thus, in this example, Lance's metadata can be providedfor reconciliation between the home computer 606 a, Lance's workcomputer 604 a, his PDA 606 a, his cell phone 608 a and the familyCD/DVD player 610. Similarly, Grace's metadata can be provided forreconciliation between the home computer 602 a, Grace's dorm computer604 c, her cell phone 608 b and the family CD/DVD player 610, and so on.

FIG. 7 is a flow diagram of steps in a method in accordance with oneembodiment. The method can be implemented in any suitable hardware,software, firmware, or combination thereof. In but one embodiment, themethod can be implemented in software.

Step 700 provides media content that can be rendered by a media-playingapplication. Any suitable content can be provided such as digital audio,digital video and/or digital audio/video and the like. In oneembodiment, such as one that is discussed above, the media content isprovided as music content. Typically, although not exclusively, suchcontent is provided as a file or files that are located on a localcomputing device such as a user's personal computer or handheld device.Such content can, however, be provided on a remotely-accessible devicesuch as another computer or server linked via a network.

Step 702 monitors multiple users' media-playing experiences. This stepcan be implemented by noting, among other things, what content isexperienced by the users and when it is experienced. In the musiccontent embodiment, this step is implemented by monitoring each user'slistening habits. Non-exclusive, specific examples of parameters thatcan be monitored are given above in the section entitled “ExemplarySchema of User Behaviors”.

Step 704 produces metadata associated with the users' media-playingexperiences. This step can be implemented by producing metadata that isassociated with the various parameters that can be monitored. Again,examples of this are provided above. Step 706 associates producedmetadata with media content experienced by the users. This is done on aper-user basis. This step can be implemented in any suitable way. Forexample, the metadata can comprise part of a piece of content thatincludes the content itself, an example of which is given above.Additionally or alternately, the metadata can be associated with anidentifier that is itself associated with the content.

Step 708 reconciles user metadata with one or more devices on which thevarious users experience content. This step can be accomplishedresponsive to a user transferring media content files between devices.That is, when the files (including the associated metadata) are pushedacross a network to another of a user's devices, the reconciliationprocess can search through the metadata and reconcile it on the otherdevices.

Alternately or additionally, this step can be accomplished responsive toa user experiencing content on different devices. For example, assumethat a user has the new U2 CD and listens to it at home. The user thentakes the CD to work and listens to it at their work computer. In thisexample, the user's work system will make note that the user haslistened to the CD and can, for example, update the user's metadataassociated with the last played time parameter. Assume also that duringa lunch break, the user rates several of the tracks on the CD using thestar-rating system described above. The user's work system can then, viathe reconciliation process mentioned above, see to it that the user'smetadata is reconciled on his home computer. In this example, only theuser's metadata (and not the media content itself) is pushed across thenetwork.

By developing metadata for multiple users and associating, in some way,the metadata with the content that the users experience, the varioususers can be provided a rich, robust, and user-specific mediaexperience. Further, by reconciling each user's metadata acrossdifferent devices that the individual users may use, each user can beassured of a content experience that is generally standardized acrossthe various devices that might be used to experience content.

Exemplary File Structure for Multiple-User Metadata

FIG. 8 shows a diagrammatic representation of an exemplary filestructure in accordance with one embodiment generally at 800. Filestructure 800 comprises a user metadata portion 802 and, optionally, acontent portion 804. Within the user metadata portion 802, user metadatafor multiple users can be maintained. As an example, metadata forindividual users 806, 808 810, 812, and 814 is shown. Any suitablenumber of users can be included in the file structure. In addition, anysuitable type of metadata can be included. Examples of metadata appearin the section entitled “Exemplary Schema of User Behaviors” above.

Note that the file structure may or may not contain the actual contentwith which the metadata is associated. In some embodiments, the contentthat is included in the file structure includes individual songs ortracks. Accordingly, the accompanying metadata is associated with theindividual tracks or songs that are included in the file structure.

Pre-Determined Number of Users

In some embodiments, it can be advantageous to limit the number of userswhose metadata is included with a file. This is especially the case whenthe content accompanies the metadata. Specifically, it can be desirableto have the size of the metadata have a limit that is defined in somerelation to the size of the content that is also included in the file.Else, there may be cases where the size of the metadata (e.g. if therewere many many users) would undesirably exceed the size of the contentitself. Thus, in some embodiments, it is desirable to maintain the sizeof the metadata somewhat smaller than the size of the content itself.

In the instance where the file structure includes individual songs ortracks, it has been found that a suitable number of users, given themetadata described above, is around five. Of course, this number mayvary depending on the type of content contained in the file structureand any compression techniques that might be used to compress the usermetadata.

Protecting the Users' Privacy

In some scenarios there is the possibility that a user will share theircontent with others. For example, in the multiple user scenario wheremultiple users share one or more devices, it is possible that one of theusers will want to share their content with others who are notnecessarily in the user's group. For example, peer-to-peer networkinghas enabled individuals to share their content with others around theglobe. There are, however, privacy concerns that are associated withthis type of sharing. Specifically, if a user shares their files (whichinclude metadata for not only them, but possibly others), if the usersare identified with any degree of precision, then it is possible thatstrangers may acquire their metadata and thus, be able to learn abouttheir listening habits. Further, if a user is identified by their emailaddress, as can sometimes be the case in peer-to-peer and otherscenarios, it is possible and quite likely that this user will findthemselves inundated with unwanted emails or spam. Needless to say, thisis an undesirable situation.

In accordance with one embodiment, the user can be identified in amanner that they (and, where applicable, others in their group) canreadily recognize, but which is not recognizable by others who are notin their group and not reversible to ascertain the user's identity.

In one example, this can be done when the user logs on to a device. Forexample, when a user logs on to a device, they typically log on usingtheir name entered as a character string. So, if John Doe logs onto adevice, they typically type in “John Doe” or “John”. A process duringlog on takes a pre-determined number of letters of the user's name, say“Joh” and then adds a string that is produced by taking a mod hash ofthe remaining letters. In one example, this can produce a three digitnumber. So, “John Doe” becomes “Joh268”.

Thus, in the example of FIG. 6 where the users include Lance, Melissa,Grace and Max, these character strings become: Lan456, Mel902, Gra222,and Max890. Thus, each of the users has enough information to ascertainwho the other users are. Yet, individuals who are strangers and outsideof this group have no way of ascertaining the true identities of theseindividuals. Hence, these strings are sufficiently precise to ensure fewcollisions, but sufficiently imprecise to not disclose personalinformation about the user. This can be especially critical in the eraof peer-to-peer music sharing.

This embodiment also provides an approach that is deterministic—meaningthat all experience points that are used by a particular user cancompute the hashed name to arrive at the same identifier.

FIG. 9 is a flow diagram of steps in a method in accordance with oneembodiment. The method can be implemented in any suitable hardware,software, firmware, or combination thereof. In but one embodiment, themethod can be implemented in software. In some embodiments, the methodis implemented in software that resides on multiple user devices onwhich a user can experience content. For example, the software canreside on the user's home computer, PDA, and work laptop if those arethe devices on which a user is likely to experience content.Advantageously, the software can be provided to be deterministic so thatthe outcomes given a particular character string are standard across alldevices.

Step 900 receives a character string associated with a user. Thischaracter string can be received when the user logs onto a particulardevice on which they intend to experience content. Alternately, thischaracter string can be received when the user first attempts toexperience content on the device. Step 902 selects a number ofcharacters from the character string. Any suitable number of characterscan be selected. Step 904 computes another character string using theremaining characters of the received character string. This step can beimplemented in any suitable way. In the example given above, a hashfunction was used to compute the character string to arrive at a threedigit string. Step 906 then combines the selected characters of theoriginal character string and the computed character string to providean identifier for the user. Step 908 associates the identifier withmetadata that is associated with content that the user can experience.

The above method permits each user to be uniquely identified in arecognizable way and to have their metadata associated securely withthem. In addition, the method of identification is secure in that it ismathematically difficult or infeasible to ascertain who an individual isfrom their identifier. In this way, the identifier can be written into amedia file. If the media file roams to another machine, then the othermachine can extract the user's playlist, as will become more apparentbelow.

In addition, all of the user's data (content and metadata) can be roamedto a central server somewhere in much the same way that a user can havea passport identifier and an electronic wallet. For example, theidentifier can be passed up to the “My Music” schema which includes acategory called “Your listening habits” to identify content that theuser likes or has played.

Clearing Out Metadata when Transferring Files

In one embodiment, when a user attempts to push or otherwise providetheir content to another device or location, the user can be give theoption of clearing out the metadata in any of the files for all of theusers. This is especially important when, for example, one user of auser group wishes to push their content to a peer-to-peer location. Byhaving the option of clearing out the metadata for all of the users,each user is assured that their personal metadata will not be availableto others. As an example, consider FIG. 10.

There a system is shown generally at 1000. A user device such as apersonal computer has a content database that includes the user'scontent as well as metadata associated with the content. In thisexample, assume that the content and metadata is in the form ofindividual media files. When a user attempts to transfer one of theirfiles to another device or location, such as a peer-to-peer location ora web site, they are presented with a user interface that enables themto select a “Clear Metadata” option. If this option is selected, all ofthe metadata is removed from each of the files that is transferredbefore the file transferred.

Intelligent Playlists

One of the things that the above-described inventive systems and methodsenable is so-called intelligent playlists or “smart playlists”. Anintelligent or smart playlist is a playlist that is, simply put, moreintelligent than static playlists. Smart playlists can embodycharacteristics that make the playlist adaptive to the user's originalintent—that is, to play music of a given and personalized type. Smartplaylists can also be more resilient in that the playlist enables theuser to continue to enjoy the playlist, as changes are made to theuser's environment that render useless static or so-called “legacy”playlists.

In some embodiments, a smart playlist can be thought of as one thatembraces a user's intent and, in some instances, can be regeneratedperiodically to refresh that intent. For example, a smart playlist canbe of “Songs I like, that I've not heard of recent” or “RecentlyAcquired Music”. In the latter example, the playlist can describe songsthat a user has obtained that are less than one month old. Thus,tomorrow's execution of the playlist will not necessarily play somesongs that were played by the user today. Thus, smart playlists can bedynamic in nature.

Smart playlists offer users an exciting new feature that departs fromthe previous, generally passive music experience. That is, in the past,to create a playlist of songs a user liked, and to maintain the playlistover time would take quite a bit of work. Smart playlists, however, canreduce or, in some instances eliminate, the amount of work required of auser to maintain an enjoyable experience.

Exemplary Playlist User Interface

FIG. 11 shows an exemplary user interface 1100 that can present aplaylist to a user for interaction. The interface includes a portion1102 that contains song titles, album, track length and rating. Noticethat the star-rating system is used where filled-in stars have beenrated by the user and clear stars have been given an effective rating bythe system. This is advantageous in that it enables the user to see notonly their ratings, but the effective ratings that have beenautomatically provided by the system. Effective ratings are discussed inthe section entitled “User_Effective_Rating” above. This category isadvantageous in that once the effective ratings are established, theycan be used by intelligent playlists (discussed below) to tailorplayback to a user's experience habits.

In addition, a portion 1104 is provided for a user to manage their medialibrary. For example, user selections in the portion include, in thisexample, “All Audio”, “All Clips”, “Album”, “Genre”, “Artist”, “MyPlaylists” and “Search”. Further, user interface portion 1106, in theform of a drop down menu, enables a user to select from their collectionof playlists. A portion 1108 provides a user interface that can be usedto enable a user to interact with media that is playing on their mediaplayer. Specific controls that are provided include a pause button, stopbutton, reverse button, fast forward button, play button and volumebutton.

Exemplary System Overview

FIG. 12 shows an exemplary system 1200 for generating and maintaining aplaylist in accordance with one embodiment. System 1200 comprises aplaylist engine 1202. The playlist engine can be implemented in anysuitable hardware, software, firmware or combination thereof. In theillustrated example, the playlist engine can be implemented in software.In but one embodiment, the playlist engine can be implemented as part ofa media player software application that is configured to play mediacontent on a computing device. Such media content can include, as notedabove, music content.

System 1200 can also comprise one or more databases. Exemplary databasesas shown at 1208 (a local database) and 1212 (a remote database). Anynumber or types of databases can be provided. In this example, localdatabase 1208 can be maintained on a local computing device or one thatis carried by a user. Remote database 1212 can be provided andmaintained by a third party. Such third party can be independent of theuser. For example, a third party web service can maintain such remotedatabases. The various databases can be used for maintaining usermetadata, media content and/or both. Examples of databases are givenabove.

Playlist engine 1202 can use one or more filters 1204, 1206, to executequeries on the various databases with which the playlist engine isutilized. These queries can be defined by a playlist file format whichis processed by the playlist engine. An exemplary playlist file formatis given below in the section entitled “Exemplary File Format”. Theplaylist file format can be used to dynamically maintain the user'splaylist. As an example, as a user plays content from one of theirplaylists, the playlist engine can execute queries defined in theplaylist file format to keep the playlist current. For example, assumethat the user has a playlist of “songs I have not heard recent” andplays one or more songs from the list. In this case, the playlistengine, on the next query of the pertinent database, would be returned aplaylist without the titles of the songs that were recently played bythe user.

In addition to using one or more filters to execute queries on localresources, system 1200 can utilize one or more filters for executingqueries on remote databases. For example, filters 1210 can be used toenable the playlist engine to query remote database 1212.

The result of the queries by the playlist engine is a playlist such asthe one shown at 1214. This playlist can be rendered via a suitable userinterface (such as user interface 1100 (FIG. 11)).

FIG. 13 is a flow diagram that describes steps in a method in accordancewith one embodiment. The method can be implemented in any suitablehardware, software, firmware or combination thereof. In the illustratedexample, the method is implemented in software. As but one example, atleast portions of the method can be implemented by a playlist enginesuch as the one described in connection with FIG. 12.

Step 1300 provides one or more filters that can be used to executequeries. Examples of filters are given below. Step 1302 queries one ormore databases using at least one filter. The databases can comprise,for example, local databases or remote databases. Step 1304 receives aresult set from the query. Step 1306 then provides the result set as aplaylist for a user. It should be noted that step 1302 can be executedresponsive to a user actually initiating a search by requesting that asearch be done. Additionally or alternately, step 1302 can beimplemented in the background, responsive to, but unbeknownst to a userinteracting with a particular media player with which the describedmethod is associated.

Exemplary File Format

In one embodiment, intelligent or smart playlists are defined by a fileformat that is processed by the playlist engine to provide one or moreplaylists. In the particular example provided and explained below, thefile is define in XML (Extensible Markup Language) through the use ofSMIL (Synchronized Multimedia Integration Language) syntax. It is to beappreciated and understood that the file format can be defined using anysuitable language, syntax, and the like, without departing from thespirit and scope of the claimed subject matter.

XML is a hierarchical, tag-based language that will be known andunderstood by those of skill in the art. SMIL enables simple authoringof interactive audiovisual presentations. SMIL is typically used for“rich media”/multimedia presentations which integrate streaming audioand video with images, text or any other media type. SMIL is anHTML-like language that will readily known and understood by those ofskill in the art.

FIG. 14 shows an exemplary file format that is defined in XML using SMILsyntax. In this example, the file format is divided into three distinctportions: a header portion, a static block portion, and a dynamic blockportion, each of which is discussed below.

The outer elements in this file format take on a SMIL syntax (e.g. the“<smil>” tags). The header, i.e. “HEAD” elements, encapsulates globalplaylist metadata. The Body elements encapsulates the actual playlistcontent. The first “SEQuence” tag (in the static block portion)encapsulates an enumerated list of static elements with intelligentname-independent auto-repair metadata as will be described in moredetail in the section entitled “Auto-Repair” below. The second“SEQuence” tag (in the dynamic block portion) encapsulates an enumeratedlist of dynamic conditions with parameters necessary to behave asauthored. Having static and dynamic portions can be useful forsupporting different types of devices. For example, some devices that auser might use may not have the capability to execute a database query.As the dynamic block portion is utilized for database queries, thesetypes of device would not use the dynamic block portion. However, byproviding a static block portion that contains data that is produced bya query, these devices can still have access to the data that resultsfrom a database query. This is discussed below in more detail in thesection entitled “Caching”.

Header Portion

The header portion of the file format encapsulates global playlistmetadata. In this example, this includes the title of the playlist, theauthor of the playlist, category, genre, one or more user names and oneor more associated user ratings.

The user names are the names of those users whose metadata areassociated with the playlist. The user ratings are ratings on theplaylist itself.

This file format is interesting and useful for a number of reasons,among which include the notion that playlists can be defined on a perpersona basis. That is, playlists can be defined in terms of andspecific to the individual users who use the playlist. So, for example,if one user chooses to rate this particular playlist a 5-star playlist,this will affect behavior within an application (e.g. the media playerapplication that uses the file format to generate a playlist) on a peruser basis.

Static Block Portion

The next portion of the file format is the static block portion. Thisportion simply contains a list of files that is produced as a result ofone or more database queries. The static block portion contains anidentifier of the user who rendered the list, the date on which the listwas rendered, and, if appropriate, when the list expires. This isexplained below in more detail.

The media source tag (“<media>” tag) contains the path of the file (e.g.dirRelativePath . . . . ). If the playlist has 100 songs, then therewill be 100 media source tags. In the case of a static playlist (e.g.for a device that cannot execute a database query), the header stillapplies and the file format can terminate after the static block.

In addition, the static block portion contains a content ID (“cid”) anda tracking ID (“tid”). These IDs are used to intelligently locate themedia objects or files to which the individual media tags refer, in theevent that the media objects or files are not located where they shouldbe. Perhaps they were deleted, renamed, moved and the like. This isdiscussed in more detail in the section entitled “Auto-Repair” below.

Dynamic Block Portion

The dynamic block portion contains one or more queries. Reading throughthe XML—there is a “querySet” tag that defines the query. A sourceFiltertag defines a source filter whose name, in this case, is the “WindowsMedia Local Music Library Filter”. This source filter ID is the actualcode that gets instantiated and executed. The instantiated code thenoperates on the data that is included in the fragment tags.

Specifically, here the instantiated code will go to the local musiclibrary and retrieve songs where the genre equals “rock”, and the artistis not equal to “Elvis”. A second filter named “Windows Media PlaylistLimit Filter” acts to limit the result set developed by the sourcefilter. In this instance, the limit filter code limits the result set,by size, to 256 Megabytes. Thus, there are source filters that produceresult sets in accordance with some criteria, and filters that operateto subtract away individual result elements.

This code then develops a list (i.e. the result of the query). This listcan then be provided back into the static block portion forlesser-enabled devices, as noted above. Now, when a lesser-enabled mediaplayer or device processes the file format, it will parse through theheader and play the titles (that it has) that are listed in the staticblock portion.

The file format described above can permit playlists to be defined thatautomatically stay up to date, without requiring the user to do anythingto update the playlist. In the illustrated and described embodiment, theintelligent or smart playlist file format can contain one or morequeries. The queries are typically based on a “truth” that transcendstime, thus enabling this playlist to be accurate for far longer thanwould a static playlist. As an example, consider a playlist entitled“Songs I like that I've not heard of recent”. This playlist can becreated by a query for songs where the “User Rating>4stars” and“LastTimePlayed>1 month”. This is on a per user basis. Thus, it isfairly easy to appreciate that as a user changes the rating of theirsongs, or plays content, that the playlist will generate different songsupon evaluation.

In addition, intelligent or smart playlists can be computed in apersonalized manner. That is, smart playlists take into account theactual user playing the playlist when the results are enumerated. As anexample, consider the playlist entitled “Songs I like that I've notheard of recent”. As noted above, this would be a query on Songs where“User Rating>4stars” and “LastTimePlayed>1 month” (on a per user basis).In this case, the playlist engine executing the smart playlist can usethe user's context (as exemplified by the user's identification) to knowwhich rating database, and which LastPlayedTime database to use. Thisresults in the same smart playlist file on disk having different meaningto different people. Advantageously, it also enables users to tradetheir smart playlists in a way that is meaningful to the recipient. Thisis so on a machine-to-machine basis, for example, across the Internet.

Moreover, smart playlists can be personalized so as to enable animproved roaming experience. Specifically, within the smart playlistfile format, user metadata is maintained that enables a user to bring asmart playlist to several of their machines or devices, and have itcharacterized the same way in each of those environments.

Caching

Recall that in the file format shown and described in connection withFIG. 14, there are two portions that are set off with “seq” tags—astatic block portion and a dynamic block portion. There can be many“seq” tags within a file. The static block portion encapsulates anenumerated list of static elements with intelligent name-independentauto-repair metadata. The dynamic block portion encapsulates anenumerated list of dynamic conditions with parameters necessary tobehave as authored. In this example, the dynamic block portion is a“seq” block that has a sub-element called “smart playlist”.

A smart playlist that is generated using only the static block portioncan be thought of as a “smart static playlist” because it contains anenumeration of the songs to play that were previously generated, at sometime in the past, by a query defined in the dynamic block portion.

In accordance with one embodiment, a file format is provided thatincludes both a static block portion that can be utilized bylesser-enabled devices, and a dynamic block portion that can be utilizedby devices that are capable of executing database queries.

As an example, consider the following. Assume that a user has a smartplaylist entitled “Songs I like that I've not heard of recent”. Thequery block in the file format would have the “User Rating>4stars” and“LastTimePlayed>1 month” clauses on a per user basis. The first time thefile format is processed and the query is executed, a set of results isgenerated in the media player application. Knowing, however, that thisplaylist may end up on lesser capable devices such as devices without adatabase, parser, and the like, the result set of the query can berendered into the same file, but in a different section of the file(i.e. the static block portion). This way the smart playlist file storesboth a static rendition of the playlist, and the query clauses.

As one example where the static block portion can be useful, considerthe following. Assume that a user wishes to burn a CD that contains bothsongs and one or more of the user's playlists that he wants his consumerelectronic device to be able to play. In this example, the consumerdevice would just process the static portion of the playlist because itis not configured to execute the dynamic part of the playlist.

To ensure that the static version does not deviate too far from theintent of the playlist, attributes can be added to the static blockportion of the file. For example and as noted above, the file cancontain attributes such as a “renderedOn” attribute the defines when thestatic block portion was rendered, and an “ExpiresOn” attribute thatdefines when the static block portion expires. These items can enablethe more intelligent/capable devices to refresh the playlists in thebackground such that they always remain fresh for the lesser capabledevices.

Further, static block portions can be rendered with individual user nameattributes. This is useful when a user desires to transfer theirspecific playlist to a CD-ROM or a portable device. The static set canthus be rendered using their user name. This can be useful in a scenariowhere this playlist makes its way back into a library and another useropens it. In this case, the media player application can be intelligentenough to not use the static block portion for the first user, butrather can regenerate a new playlist using the correct user data for thenew user.

FIG. 15 is a flow diagram that describes steps in a method in accordancewith one embodiment. The method can be implemented in any suitablehardware, software, firmware or combination thereof. In the illustratedexample, the method is implemented in software. As but one example, atleast portions of the method can be implemented by a playlist enginesuch as the one described in connection with FIG. 12.

Step 1500 defines a file having a portion that can contain staticplaylist data and a portion that can contain one or more queries. Anexemplary file format is described above. It is to be appreciated thatany suitable file format can suffice. The term “static playlist data” isintended to include, without limitation, a list of media content, suchas files and the like, that can be utilized as a playlist. The term“static” is intended to mean that the list can be utilized by a devicethat is not configured or able to execute database queries. In thissense, the playlist is static in that it is simply a flat list.

Step 1502 executes one or more queries contained in the file to providea result set. This step can be implemented by a suitably configuredcomputing device, such as one that has access to a database thatcontains the data that is utilized to provide a playlist. Step 1504provides the result set as a static rendition of the playlist in thefile. But one example of how this can be done is given above. Step 1506transfers the file to one or more computing devices that can utilize theplaylist to display for a user. If the devices are suitably enableddevices, then such devices can typically use the one or more queries tomaintain current playlists on the devices. If, on the other hand, thecomputing devices are not suitably configured devices that can executedatabase queries, then such devices can simply use the static playlistdata to provide playlists for the user.

Extensibility Mechanisms

In one embodiment, the playlists that are generated by the playlistengine are extensible. This is advantageous because it can enablevirtually anyone to write software code that can be used as a filter toprovide a playlist. This can be especially useful for third parties,such as third party vendors or external web services, who desire toprovide meaningful extensions to the rich playlist data that a user canutilize.

Within the SmartPlaylist element block (see FIG. 14), one or more“querySet” elements are defined. Within a “querySet”, there is typicallyone or more “SourceFilter” elements, and zero or more “Filter”elements”. In one embodiment, there can be only one “SourceFilter”within a “querySet”. Both “SourceFilter” and “Filter” elements arebacked by class objects (i.e. software) that are invoked to interpretthe “fragments” within their element block, as discussed above. Thispermits a smart playlist to call upon external code to interpret whatshould be permitted to be a part of the resultant set of media in theplaylist.

In this example, a “SourceFilter” is different from a “Filter” in thatit creates content as a result of its processing, whereas a “Filter”does not create content. Rather, a “Filter” removes or otherwise limitsthe content that is provided by a “SourceFilter”. For example, thisSourceFilter:

<sourceFilter type=“smartFilterObject” id=“GUID” name=“Windows MediaLocal Music Library Filter”> <fragment name=“Genre”> <argumentname=“Condition”>EqualTo</argument> <argumentname=“Value”>Rock</argument> </fragment>

is going to yield content where “Genre equals Rock” from the “WindowsMedia Local Music Library”. This means that the output of this object isa list of “Rock” media that exists in a library.

A “Filter”, on the other hand, brings no media to the equation, but hasrejection rights on any media brought to the equation from the“SourceFilter” objects. That is to say that the “Filter” objectsliterally just remove or filter out content. For example, this Filter:

<filter type=“smartFilterObject” id=“GUID” name=“Windows Media PlaylistLimit Filter”> <fragment name=“LimitBySize”> <argumentname=“NumberOfMegabytes”>256</argument> </fragment>

is going to limit the size of the result set of music to be 256 MBs.Thus, this filter does not add media, it just lets data pass throughuntil its criteria is met.

In this particular embodiment, fundamental to this capability is havingapplication program interfaces (APIs) that are able to pass around a“media object” that reflects the individual media being sourced, and allits relevant attributes such as Title, Artist, Genre, Filename, Filesize, duration, and so on. The above LimitBySize filter would use theFileSize metadata to enable its decision.

In this embodiment, by virtue of the design of the XML, any suitableidentifier (e.g. “GUID”, classId and name, GUID and URL string) can beused for a filter. Thus, when executing this code, the playlist enginewould simply just launch whatever source filter is registered in thelist. This can enable third parties to provide their own filters forextensibility, as will be appreciated by those of skill in the art.

As an example, consider the following. Not all filters need to use alocal database as a source for sourceFilter or Filter logic. The codethat can be invoked by the playlist engine can really be providedanywhere. Here are two examples:

An example of a “Filter”, could be the “Amazon.com Top 100 Best SellersList”. Thus, whenever a playlist file is evaluated, the software codecan be invoked and the code implementing the “Amazon Best Sellers List”can take a media object that it is given (e.g. a media object thatcontains one song of a list of songs that a user has in their personallibrary), send the media object to an appropriate web site to see if thesong on the list of songs appears on Amazon's best sellers list. If thesong is on the list, then the song is allowed into the playlist. If thesong is not on Amazon's list, then the song is not allowed on theplaylist. An exemplary filter specification is given below.

<filter type=“smartFilterObject” id=“GUID” name=“Amazon Top 100 BestSeller List”> <fragment name=“ListName”> <argumentname=“ListURL”>www.amazon.com\AT100BSL.asp%AMGID%</argument> </fragment>

The above example is explained in the context of a logical, lesserefficient implementation. One embodiment of this implementation is tofirst download the list of the 100 Best Sellers and then do all thecomparisons locally for efficiency.

Another example of a “SourceFilter” can be a “peer-to-peer” samplesservice such as “FYE Music”. Being a Source Filter, the name and thefragments passed in will define the scope of the result set returned. Inthis example, the FYE service can return back a list of music hosted ona server where Genre=Rock. Because the source filter passed back “mediaobjects”, each media object can have an URL to the actual content, thusmaking the resultant playlist work on the user's media player. Forexample, assume that a user wants to listen to those songs that are on“the Amazon Top 100 Best Sellers List” that are also on the “Billboard100”. In this example, the user does not own the specific media. Thecontents of the smart playlist that results from the user's query is aresult set that contains a list of these songs. In addition to providinga list of these songs, other third parties, such as the content owners,can also source the content. That is, the playlist that is generated anddisplayed for the user can have associated URLs to the actual content sothat the user's device can go onto the Internet and the user canpurchase and/or retrieve the song.

Thus, in accordance with the above-described embodiment, there can bemultiple classes of code, each voting on whether a media item should bein a playlist. In addition, code can be provided that uses logic anddata that is external to the playlist and the collection of mediaobjects representing the items in the playlist. An example of this isthird party code that can provide filters that are accessible via anetwork such as the Internet. For example, assume that a user defines aplaylist for “All the songs that I have whose artists' birthdays arethis week”. The birthday information is not information that the usercurrently has. Rather, a third party has this information. Thus, whenthe playlist file is processed by the playlist engine, the playlistengine produces a list of the songs that the user has. The playlistengine can then send this media object for each item in the sourcefilter's return set to a third party, as specified in the playlist file,which third party can then take the media objects created by the userand filter it in accordance with their own data. The third party canthen return or filter out the media object prior to execution.

Additionally, through the use of the structure provided in theillustrated and described XML file, smart playlists can be authored toproduce a variety of operations that are facilitated with any suitableBoolean operators, e.g. AND and OR logic, as will be appreciated andunderstood by those of skill in the art. Thus, the robust possibilitiesfor playlist rendering are seemingly endless. As but one example,consider the playlists described in the section entitled “ExemplaryPlaylists” immediately below.

Exemplary Playlists

The following constitutes but one exemplary listing of playlists thatcan be provided utilizing the inventive techniques described above. Theplaylists can make use of one or more of the parameters described abovein the section entitled “Exemplary Schema of User Behaviors.”

“My favs -- All 4 and 5 star rated songs” Filter: Type = audio,UserRating > 70, Sort: UserRating “My favs -- 64 Mb worth of 4 + 5 starrated songs” Filter: Type = audio, UserRating > 70, LimitFilter = 64 MBSort: UserRating “My favs -- 128 Mb worth of 4 + 5 star rated songs”Filter: Type = audio, UserRating > 70, LimitFilter = 128 MB Sort:UserRating “My favs -- One CD-R worth of 4 + 5 star rated songs” Filter:Type = audio, UserRating > 70, LimitFilter = 630 MB Sort: UserRating “Myfavs, that I've not heard of recent” Filter: Type = audio, UserRating >70, Sort: UserLastPlayedTime “Workday 100 -- Favorite Weekend songs”Filter: Type = audio, UserRating > 70, Limit items to 100 Sort:UserPlaycountWeekend “Weekend 100 -- Favorite Weekdays songs” Filter:Type = audio, UserRating > 70, Limit items to 100 Sort:UserPlaycountWeekday “Caffinated 100 -- Favorite Late Evening songs”Filter: Type = audio, UserRating > 70, Limit items to 100 Sort:UserPlaycountNight “Recently Aquired Music” Filter: Type = audio,UserLastPlayedTime = <filter condition.. E.g.: In the last Month> Sort:AquisitionTime “Recently Aquired Music (Yet to be rated)” Filter: Type =audio, AquisitionDate = <in the last Month>, UserRating = <NULL>, Sort:AquisitionTime “Songs I've not heard of recent” Filter: Type = audioSort: User Rating, then UserLastPlayedTime (strongest sort) “Songs notyet rated” Filter: Type = audio, UserRating = <NULL>, Sort: Album, thenArtist (strongest sort) “Sucky music -- Songs I dislike and shoulddelete” Filter: Type = audio, UserRating = <10 Sort: Album, then Artist(strongest sort) “Songs with digital rights management” Filter: Type =audio, Protected = Yes Sort: Album, then Artist (strongest sort) “Songsother users like” Filter: Type = audio, ServiceRating > 70 Sort:UserRating “My Kazaa Music -- All of it” Filter: Type = audio,PathFilter Contains “Kazaa” Sort: Album, then Artist (strongest sort)“My Kazaa Music -- Recently Aquired” Filter: Type = audio, PathFilterContains “Kazaa”, AquisitionDate = <in the last Month> Sort:AquisitionTime “Hi-Res video clips” Filter: VIDEO_VIDEO_WIDTH > 300Sort: Title

Auto-Repair

In accordance with one embodiment, playlists are imparted withcharacteristics that enable them to be repaired automatically.

As an example, consider the following. Once a media item is resolved andadded to the static block portion of the playlist file, data associatedwith the media item, including the path to the media item, is there instatic form. The actual object or file that is referred to by the mediaitem, however, can be altered in many ways. For example, the object orfile can be deleted, renamed, moved, and the like. Thus, in thisembodiment, playlists are provide to be more robust through the use of acouple of different characteristics. First, however, recall thecomponents of the file structure as set forth below.

<media src=“dirRelativePath.wma” cid=“GUID” tid=“GUID”><FileTrackingBLOB>0x00....x00</FileTrackingBLOB> </media>

There, each media source includes a path, a content ID (“cid”) and atracking ID (“tid”). These IDs are embodied as globally uniqueidentifiers or “GUIDs”, (e.g.: “F1B9284F-E9DC-4e68-9D7E-42362A59F0FA”).The “FileTrackingBLOB” tag pertains to a “Binary Large Object”—a stringof binary numbers. This is an older, less compact, less robust versionof a tracking ID provided for compatibility purposes with older versionsof Windows.

Content IDs

The content ID is an identifier that is assigned to every song or pieceof media content. The content ID is analogous to an ISBN on a book orthe UPC code on a per-food item. That is, in the case of a book,regardless of the printing, the same book will have a common ISBNnumber.

Typically, this identifier can be assigned by a third party service. Inthe illustrated example, if a song or piece of content has metadataassociated with it, it will be provided with a content ID. The contentID of a song or piece of media content can remain the same regardless ofwhether the metadata associated with the content changes. For example,when a user inserts a CD into their personal computer, the media playercan cause the computer to access and retrieve textual, factual metadatafor that CD on behalf of the user. Typically, this can be done by abackground process via a network-accessible server that contains themetadata information. The net result of this process is that the usergets textual data (i.e. metadata) that describes the CD that did notpreviously exist on that CD. When this process is performed, a contentID that is associated with each track or song can also be assigned. Thiscontent ID is universally the same, i.e. everyone receives the samecontent ID for the same songs or tracks. Thus, if a user receives aplaylist via email from a friend, it can contain content IDs for thesongs on that playlist, which content IDs are the same for thecorresponding content that the recipient owns. This enables users toshare playlists and play songs even though they are stored in differentplaces in the file system or in different file systems.

One scenario worth pointing out here is that of two teenage users withsimilar taste in music, sharing their playlist but not their content.Because of the content IDs in the playlist, the playlist will functionon both machines for all of the content that is on that machine. Thisworks because when the playlist is processed by the playlist engine andplayed, the content ID is used to query the user's music database forcontent having the “content ID”. If the corresponding content is found,the playlist is auto-repaired, i.e. automatically repaired, with theappropriate local path of the recipient's media.

Tracking IDs

In the event that the content does not have a content ID (perhaps thecontent was created with a tool that did not write a content ID for thecontent), the system can rely on a tracking ID or “tid” to repair thecontent's path. A tracking ID is essentially an identifier that isutilized by the device's file tracking system to track files. The notionof tracking IDs for purposes of file tracking within file systems isunderstood by those skill in the art. For example, in the NT filesystem, an “object ID” is used that is more robust than those trackingIDs used in the past. The object ID allows one to maintain a smallnumber (a GUID) that is associated with every file that is stored on anNT File System. This object ID is tightly bound to the file such that ifthe file is copied from one physical hard drive to another physical harddrive, the object ID is carried with the file. This permits efficientfile tracking, as those of skill in the art will appreciate andunderstand.

Thus, if a particular piece of content does not have a content ID or,alternately, if the content ID does not result in the content ofinterest being located, the system can utilize the tracking ID in anattempt to locate the content of interest. In this example, the device'sfile system can be used to attempt to locate the content of interestusing the tracking ID. If the content of interest is found, then theplaylist can be repaired with the content's path. In this particularexample and in the event that the tracking ID cannot locate the contentof interest, then the system can attempt to use any other methods tolocate the content. For example, the “FileTrackingBLOB” referred toabove is one such legacy version of the Window OS link tracking ID thatis somewhat bigger and less resilient than the tracking ID—yet can stillpermit content of interest to be found.

Locating the content can take place relative to the user's local device.Alternately, the various techniques described above and below can beused to locate content across network-connected devices (e.g.LAN-connected or WAN-connected devices).

FIG. 16 is a flow diagram that describes steps in a method in accordancewith one embodiment. The method can be implemented in any suitablehardware, software, firmware or combination thereof. In the illustratedexample, the method is implemented in software. As but one example, atleast portions of the method can be implemented by a playlist enginesuch as the one described in connection with FIG. 12.

Step 1600 provides one or more identifiers. Any suitable types ofidentifiers can be provided. Examples of identifiers are given above.Step 1602 associates the identifier(s) with media content that can berendered by a computing device. Any suitable media content can be usedfor the purpose of associated the identifier(s). In but one example thatis utilized throughout this text, the media content comprises musiccontent. In addition, this step can implemented in any suitable way. Forexample, one or more identifiers can be associated in a media contentfile that includes the media itself. This can take place, for example,when the media content is created. Alternately, identifiers can beassociated with the media content after the media content is createdand, for example, received by the user. Step 1604 receives a playlistfile that describes various media content. This step can be implementedby a suitably configured playlist engine, such as the one describedabove.

Step 1606 attempts to locate the media content using path data that isincluded with the playlist file. In but one example, this step can beimplemented by providing, in the playlist file, a path description tothe media content such as a URL. In this example, the media player orsome other software component attempts to follow the path description tothe appropriate media content. Step 1608 determines whether the contentis found. If the content is found, then step 1610 can play the contentfor the user. If, on the other hand, the content is not found, then step1612 attempts to locate the media content using one or more of theidentifiers. If, by using the identifier(s) the content is found (atstep 1614), then step 1616 repairs the playlist by inserting the correctpath description into the playlist and the content can be played. If, onthe other hand, the content is not found, then step 1618 can skip thecontent.

After step 1610 plays the content, step 1611 determines whether anyassociated identifiers for the content is (are) missing. If the contentis missing identifiers, then the method can branch to step 1616 andattempt to repair the playlist. This can be done by attempting to obtainidentifiers for the content and then associating the identifiers withthe content. One way of obtaining identifiers for the content is toattempt to obtain the identifiers via a third party service that assignsidentifiers. For example, such can be accomplished by accessing a webservice via the Internet to obtain one or more identifiers. If noidentifiers are missing, then step 1613 does nothing.

CONCLUSION

Various systems and methods described above permit a user's contentexperience (e.g. music playing experience) to be monitored and formetadata describing this experience to be collected. This metadata canbe dynamically updated as a user experiences media content and then usedto impart to the user a personalized experience that is tailored to thatspecific user. A user's metadata can, in some instances, provided acrossa wide variety of computing devices on which the user may experience themedia content, thus standardizing the user's personalized mediaexperience. In addition, intelligent or “smart” playlists can beprovided which, in some instances, can be dynamically and automaticallyupdated to reflect current user experiences, thus providing a highlypersonalized and enjoyable content experience.

Although the invention has been described in language specific tostructural features and/or methodological steps, it is to be understoodthat the invention defined in the appended claims is not necessarilylimited to the specific features or steps described. Rather, thespecific features and steps are disclosed as preferred forms ofimplementing the claimed invention.

1. A system comprising: means for monitoring multiple users'media-playing experiences using a first device on which one or moreusers can experience the media; means for identifying each of the userswith an identifier, each user's identifier being recognizable by itsassociated user, but not being mathematically reversible to ascertainthe associated user's actual identity; means for producing metadataassociated with the users' media-playing experiences; means forassociating produced metadata with media content experienced by theusers; means for maintaining, for individual users, at least themetadata in a database on the first device; means for updating metadataon at least a second device that can be used by one or more user toexperience the media, said means for updating providing metadata fromthe first device to at least the second device; and means for using themetadata to automatically personalize one or more playlists on the firstand second devices for at least one of the users to reflect a user'smedia-playing experience.
 2. The system of claim 1, wherein the meansfor monitoring comprises means for monitoring the users' music-playingexperiences.
 3. The system of claim 1, wherein: the means for monitoringcomprises means for monitoring the users' music-playing experiences; andthe means for producing comprises means for producing metadata for eachsong that a user plays.
 4. The system of claim 1, wherein the means formonitoring comprises a media-playing application configured to playmedia that one or more users can experience.
 5. The system of claim 1,wherein the means for monitoring is embodied on a computing device onwhich one or more users can experience the media.
 6. The system of claim1, wherein the means for monitoring monitors media that is locallystored on a computing device and locally played on the computing device.7. The system of claim 1, wherein the means for updating is configuredto use, at least in part, a third party.
 8. The system of claim 1,wherein the means for updating comprises means for providing both themetadata and its associated media content to at least the second device.